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CLAIMS 

1 . A method for executing uniprocessor (UP) coded workloads in a multiprocessor 
(MP) computer system without having to rewrite the UP-coded workloads' code, the 
method comprising the steps: 

organizing the UP-coded workloads into one or more concurrency groups, 
wherein UP-coded workloads in the same concurrency group are not permitted to execute 
concurrently with one another in the MP computer system; 

scheduling first and second execution vehicles that respectively execute on differ- 
ent processors in the MP computer system at substantially the same time; 

acquiring a first concurrency group by the first execution vehicle and a second 
concurrency group by the second execution vehicle; and 

executing UP-coded workloads in the first concurrency group through the first 
execution vehicle at substantially the same time as UP-coded workloads in the second 
concurrency group are executed through the second execution vehicle. 

2. The method according to claim 1, wherein the UP-coded workloads are UP-coded 
threads, and the first and second execution vehicles are first and second processes. 

3. The method according to claim 1 , wherein the UP-coded workloads are messages, 
and the first and second execution vehicles are first and second threads. 

4. The method according to claim 1, wherein the step of acquiring the first and sec- 
ond concurrency groups further comprises: 

dequeueing from a concurrency-group run queue a first concurrency-group data 
structure associated with the first concurrency group; and 

dequeueing from the concurrency-group run queue a second concurrency-group 
data structure associated with the second concurrency group. 

5. The method according to claim 4, further comprising: 
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setting a first CG flag in the first concurrency-group data structure to a value indi- 
cating that the first concurrency group is in a running state; and 

setting a second CG flag in the second concurrency-group data structure to a 
value indicating that the second concurrency group is in a running state. 

6. The method according to claim 4, further comprising: 

appending UP-coded workloads enqueued on a first current queue in the first 
concurrency-group data structure onto a first active queue in the first concurrency-group 
data structure; and 

appending UP-coded workloads enqueued on a second current queue in the sec- 
ond concurrency-group data structure onto a second active queue in the second 
concurrency-group data structure. 

7. The method according to claim 6, further comprising: 

dequeueing UP-coded workloads in the first and second concurrency groups from 
the first and second active queues, respectively; and 

executing the dequeued UP-coded workloads to completion. 

8. The method according to claim 5, further comprising: 

in response to the first execution vehicle finishing execution of the UP-coded 
workloads in the first concurrency group, the first execution vehicle performing the steps: 

A) if at least one UP-coded workload in the first concurrency group is 
executable: 

(i) setting the value of the first CG flag to a value indicat- 
ing that the first concurrency group is in a queued state; 

(ii) re-enqueueing the first concurrency-group data struc- 
ture onto the concurrency-group run queue; 

B) if there are not any UP-coded workloads in the first concurrency 
group that are executable, setting the first CG flag to a value indicating that the 
first concurrency group is in a suspended state; 
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C) dequeueing from the concurrency-group run queue a third 
concurrency-group data structure associated with a third concurrency group; and 

D) setting a third CG flag in the third concurrency-group data structure to 
a value indicating that the third concurrency group is in a running state. 

9. The method according to claim 1, wherein at least one of the UP-coded workloads 
is organized into the one or more concurrency groups at run-time. 

10. The method according to claim 1, wherein the MP computer system is a network 
cache. 

11. A multiprocessor (MP) computer system configured to execute uniprocessor (UP) 
coded threads without having to rewrite the UP-coded threads' code, the MP computer 
system comprising: 

a plurality of processors; 

a memory having a plurality of storage locations addressable by the plurality of 
processors for storing data and program code, the memory being configured to store a 
separate concurrency-group data structure for each of a plurality of concurrency groups, 
each concurrency-group data structure comprising: 

an active-queue pointer storing a location in the memory of an active 
queue of UP-coded thread messages associated with UP-coded threads in an ex- 
ecutable state; and 

a current-queue pointer storing a location in the memory of a current 
queue of UP-coded thread messages associated with UP-coded threads waiting to 
be transferred to the active queue. 

12. The MP computer system according to claim 1 1 , wherein each concurrency-group 
data structure further comprises a CG flag that stores a value indicating an operational 
state of a concurrency group associated with the concurrency-group data structure. 
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13. The MP computer system according to claim 11, wherein each UP-coded thread 
message stored in the active queue and current queue stores a location in the memory of a 
top of a call stack associated with a specific UP-coded thread. 

14. The MP computer system according to claim 13, wherein the call stack is accessi- 
ble through a thread control block (TCB) associated with the specific UP-coded thread, 
the TCB including a CG pointer for storing a memory location of a concurrency-group 
data structure. 

15. The MP computer system according to claim 11, wherein each concurrency-group 
data structure further comprises meta-data information associated with a concurrency 
group. 

16. The MP computer system according to claim 11, wherein the MP computer sys- 
tem is a network cache. 

17. An apparatus for executing uniprocessor (UP) coded workloads in a multiproces- 
sor (MP) computer system without having to rewrite the UP-coded workloads' code, the 
method comprising the steps: 

means for organizing the UP-coded workloads into one or more concurrency 
groups, wherein UP-coded workloads in the same concurrency group are not permitted to 
execute concurrently with one another in the MP computer system; 

means for scheduling first and second execution vehicles that respectively execute 
on different processors in the MP computer system at substantially the same time; 

means for acquiring a first concurrency group by the first execution vehicle; 

means for acquiring a second concurrency group by the second execution vehicle; 

and 

means for executing UP-coded workloads in the first concurrency group through 
the first execution vehicle at substantially the same time as UP-coded workloads in the 
second concurrency group are executed through the second execution vehicle. 
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1 8. The apparatus according to claim 1 7, wherein the UP-coded workloads are UP- 
coded threads, and the first and second execution vehicles are first and second processes. 

19. The apparatus according to claim 17, wherein the UP-coded workloads are mes- 
sages, and the first and second execution vehicles are first and second threads. 

20. The apparatus according to claim 17, further comprising: 

means for dequeueing from a concurrency-group run queue a first concurrency- 
group data structure associated with the first concurrency group; and 

means for dequeueing from the concurrency-group run queue a second 
concurrency-group data structure associated with the second concurrency group. 

21 . The apparatus according to claim 20, further comprising: 

means for setting a first CG flag in the first concurrency-group data structure to a 
value indicating that the first concurrency group is in a running state; and 

means for setting a second CG flag in the second concurrency-group data struc- 
ture to a value indicating that the second concurrency group is in a running state. 

22. The apparatus according to claim 20, further comprising: 

means for appending UP-coded workloads enqueued on a first current queue in 
the first concurrency-group data structure onto a first active queue in the first 
concurrency-group data structure; and 

means for appending UP-coded workloads enqueued on a second current queue in 
the second concurrency-group data structure onto a second active queue in the second 
concurrency-group data structure. 

23. The apparatus according to claim 22, further comprising: 

means for dequeueing UP-coded workloads in the first and second concurrency 
groups from the first and second active queues, respectively; and 

means for executing the dequeued UP-coded workloads to completion. 
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24. The apparatus according to claim 21 , further comprising: 

means for setting the value of the first CG flag to a value indicating that the first 
concurrency group is in a queued state or in a suspended state; and 

means for re-enqueueing the first concurrency-group data structure onto the 
concurrency-group run queue. 

25. A computer-readable media comprising instructions for execution in one or 
more processors for executing uniprocessor (UP) coded workloads in a multiprocessor 
(MP) computer system without having to rewrite the UP-coded workloads' code, the 
method comprising the steps: 

organizing the UP-coded workloads into one or more concurrency groups, 
wherein UP-coded workloads in the same concurrency group are not permitted to execute 
concurrently with one another in the MP computer system; 

scheduling first and second execution vehicles that respectively execute on differ- 
ent processors in the MP computer system at substantially the same time; 

acquiring a first concurrency group by the first execution vehicle and a second 
concurrency group by the second execution vehicle; and 

executing UP-coded workloads in the first concurrency group through the first 
execution vehicle at substantially the same time as UP-coded workloads in the second 
concurrency group are executed through the second execution vehicle. 

26. The computer-readable media according to claim 25, wherein the UP-coded 
workloads are UP-coded threads, and the first and second execution vehicles are first and 
second processes. 

27. The computer-readable media according to claim 25, wherein the UP-coded 
workloads are messages, and the first and second execution vehicles are first and second 
threads. 

28. A method for executing workloads in a multiprocessor (MP) computer system, the 
method comprising the steps: 
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organizing the workloads into one or more concurrency groups, wherein work- 
loads in the same concurrency group are not permitted to execute concurrently with one 
another in the MP computer system; 

scheduling first and second execution vehicles that respectively execute on differ- 
ent processors in the MP computer system at substantially the same time; 

acquiring a first concurrency group by the first execution vehicle and a second 
concurrency group by the second execution vehicle; and 

executing workloads in the first concurrency group through the first execution ve- 
hicle at substantially the same time as workloads in the second concurrency group are 
executed through the second execution vehicle. 

29. The method according to claim 28, wherein the step of acquiring the first and sec- 
ond concurrency groups further comprises: 

dequeueing from a concurrency-group run queue a first concurrency-group data 
structure associated with the first concurrency group; and 

dequeueing from the concurrency-group run queue a second concurrency-group 
data structure associated with the second concurrency group. 

30. The method according to claim 29, further comprising: 

setting a first CG flag in the first concurrency-group data structure to a value indi- 
cating that the first concurrency group is in a running state; and 

setting a second CG flag in the second concurrency-group data structure to a 
value indicating that the second concurrency group is in a running state. 

3 1 . The method according to claim 29, further comprising: 

appending workloads enqueued on a first current queue in the first concurrency- 
group data structure onto a first active queue in the first concurrency-group data struc- 
ture; and 

appending workloads enqueued on a second current queue in the second 
concurrency-group data structure onto a second active queue in the second concurrency- 
group data structure. 
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32. The method according to claim 3 1 , further comprising: 

dequeueing workloads in the first and second concurrency groups from the first 
and second active queues, respectively; and 

executing the dequeued workloads to completion. 



33. The method according to claim 30, further comprising: 

in response to the first execution vehicle finishing execution of the workloads in 
the first concurrency group, the first execution vehicle performing the steps: 

A) if at least one workload in the first concurrency group is executable: 

(i) setting the value of the first CG flag to a value indicat- 
ing that the first concurrency group is in a queued state; 

(ii) re-enqueueing the first concurrency-group data struc- 
ture onto the concurrency-group run queue; 

B) if there are not any workloads in the first concurrency group that are 
executable, setting the first CG flag to a value indicating that the first concurrency 
group is in a suspended state; 

C) dequeueing from the concurrency-group run queue a third 
concurrency-group data structure associated with a third concurrency group; and 

D) setting a third CG flag in the third concurrency-group data structure to 
a value indicating that the third concurrency group is in a running state. 
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